Sensory Modality Segregation
نویسنده
چکیده
Why are sensory modalities segregated the way they are? In this paper we show that sensory modalities are well designed for self-supervised crossmodal learning. Using an unsupervised speech categorization task with visual (moving lips) and auditory (sound signal) inputs, we show that very informative auditory dimensions actually harm performance when moved to the visual side of the network. It is better to throw them away than to consider them part of the “visual input”. We explain this finding in terms of the statistical structure in sensory inputs.
منابع مشابه
Delay activity and sensory-motor translation during planned eye or hand movements to visual or tactile targets.
To perform eye or hand movements toward a relevant location, the brain must translate sensory input into motor output. Recent studies revealed segregation between circuits for translating visual information into saccadic or manual movements, but less is known about translation of tactile information into such movements. Using human functional magnetic resonance imaging (fMRI) in a delay paradig...
متن کاملRepresentations of Taste Modality in the Drosophila Brain
Gustatory receptors and peripheral taste cells have been identified in flies and mammals, revealing that sensory cells are tuned to taste modality across species. How taste modalities are processed in higher brain centers to guide feeding decisions is unresolved. Here, we developed a large-scale calcium-imaging approach coupled with cell labeling to examine how different taste modalities are pr...
متن کاملPsychophysical elements of place and modality specificity in the thalamic somatic sensory nucleus (ventral caudal, vc) of awake humans.
Discrete anatomic structures in the monkey somatic sensory thalamus may segregate input arising from different peripheral receptors and from different parts of the body. It has been proposed that these structures serve as components of modality- and place-specific pathways from the periphery to the cortex. We now test this hypothesis by examining the modality- and place-specific segregation of ...
متن کاملRegulation of burst dynamics improves differential encoding of stimulus frequency by spike train segregation.
Distinguishing between different signals conveyed in a single sensory modality presents a significant problem for sensory processing. The weakly electric fish Apteronotus leptorhynchus use electrosensory information to encode both low-frequency signals associated with environmental and prey signals and high-frequency communication signals between conspecifics. We identify a mechanism whereby th...
متن کاملModality-Specific Axonal Regeneration: Toward Selective Regenerative Neural Interfaces
Regenerative peripheral nerve interfaces have been proposed as viable alternatives for the natural control of robotic prosthetic devices. However, sensory and motor axons at the neural interface are of mixed sub-modality types, which difficult the specific recording from motor axons and the eliciting of precise sensory modalities through selective stimulation. Here we evaluated the possibility ...
متن کامل